Local cause of coherence in Boolean networks 
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Abstract 



We performed a numerical study on random 
Boolean networks with power-law rank outdegree 
distributions to find local structural cause for the 
emergence of high or low degree of coherence in 
binary state variables. The degree of randomness 
and coherence of the binary sequence are measured 
by entropy and mutual information, depending on 
local structure that consists of a node with a highly 
connected, called hub and its upstream nodes, and 
types of Boolean functions for the nodes. With a large 
number of output connections from a hub, the effects 
of Boolean function on the hub are more prominent. 
The local structures that give larger entropy tend to 
give rise to larger mutual information. Based on the 
numerical results and structural conditions we de- 
rived a time-independent transmission characteristic 
function of state variables for the local structures. 
We obtained good relationships between the nu- 
merical and analytical results, which indicate that 
dynamical properties from the whole networks can 
be inferred from the differences in the local structures. 

keywords: Boolean networks; power-law; coher- 
ence; mutual information; entropy; transcriptional 
regulatory networks 
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1 Introduction 

Biological system consists of complex adaptive 
systems, for example, neural and transcriptional 
regulatory systems whose structures often can be 
abstracted to a graph or network. In general, the 
systems perform their functions correctly when 
certain appropriate communications among nodes 
are established, because such systems need to add 
or delete own nodes, or change the strength of 
connectivity to optimally adapt to exogenous in- 
puts. The transcriptional regulatory network is one 
of the complex adaptive systems where the node 
mainly corresponds to the transcriptional unit, and 
responds to the environmental changes to survive 
and proliferate. The Boolean network [Ij is one of 
the discrete dynamical models for the transcriptional 
regulatory network and exhibits binary sequences of 
the state variables that represent expression pattern 
of the transcriptional regulatory network. Since the 
state variables in the Boolean network are sensitive 
to inputs from other nodes via directed edges, and 
affect other nodes , quality of communication is 
characterized as the size of mutual information. The 
mutual information indicates the degree of coherence, 
synchronization, amount of information content in 
the state variables, or potential for computational 
capability of the network [2j. 

In this study, we show local structural cause for the 
emergence of coherence in a Boolean network. Since 
we embedded power-law rank output connectivity 
distributions in the Boolean networks whose input 
connectivity i^in= 2, the model networks have 



some hubs that integrate many output connections. 
Because the hubs synchronously transmit their state 
to the downstream nodes, the downstream nodes are 
affected by single or multiple hubs simultaneously. 
The structural condition seems to automatically pro- 
vide global coherence in the state variables; however, 
the structural aspects give only possible influence 
from the hubs. In fact, we need to consider a type 
of Boolean function at the hubs and their upstream 
nodes. We show both the effects of Boolean functions 
and the number of output connections on the size of 
entropy and mutual information. In addition, some 
results can be explained by transmission characteristic 
functions that are derived from the numerical results 
and local structures. 

Please note that Tables [2]-[3] and Figs. [4]-[6] can 
be found in Sec. [H Appendix. 

2 Model 

Dynamics of the Boolean networks [J^^ are deter- 
mined by 

X,{t + l) = B,[X{t)] (i = l,2,...,iV), (1) 

where X{t) is the binary state, either or 1, of node 
i at time t; Bi{-) is the Boolean function [see Table 
[1] used to simultaneously update the state of node i; 
and X{t) is a binary vector that gives the states of 
the N nodes in the network. After assigning initial 
states X{0) to the nodes, the successive states of the 
nodes are updated by input states and its Boolean 
function. The dynamical behavior of these networks is 
represented by the time series of the binary states. The 
time course follows a transient phase from an initial 
state until a periodic pattern, known as an attractor, 
is eventually established. 

Table 1: Four of 16 Boolean functions with indegree 
Kin= 2. In this paper, only 1, 2, 4, and 8 are used 
because of the feasibility and biological meaning of the 
functions [3^ 4J. 
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3 Numerical Condition 

We constructed 10^ Boolean networks in each 
power-law rank distribution [see Fig. [1] with fixed 
network size. 2x10^ initial states were applied to each 
network. Four different Boolean functions [see Table 
[1] were used in almost equal probability [see Table [2]. 
Please note that all the generated networks use the 
same amount of resources since the size of network is 
fixed-256 nodes and 512 directed edges. 
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Figure 1: Power-law rank connectivity distributions 
in the model. Power exponent, 7 for type I and II is 
about 0.8 and 0.5, respectively, where Koutijank) ~ 
rank~^. We performed only a single network size of 
256 in this paper. 

We measured entropy (randomness) and mutual 
information (coherence) of the state variables to char- 
acterize the dynamics of the Boolean networks [2| [5] 
[see Fig. [2]. 



4 Results 

4.1 Numerical results 

In total, we obtained 70622 and 177098 attractors 
from type I and type II distribution, respectively. Size 
of entropy and mutual information are measured from 
the attractors. Together with the network structural 
condition, we show the dependence of distribution's 
rank on entropy and mutual information in Fig. [3l 
The dependence of the Boolean function on entropy 
and mutual information is prominent in higher ranked 
hubs on both the output distribution styles. The 
Boolean functions that give larger entropy tend to give 




Figure 2: Flow of state variables from upstream to 
downstream. Since input connectivity for all nodes is 
equal to 2 (=K^^), there are two pathways for mutial 
information in each node. Input sequence Inn for the 
node i is the same as the output sequence of an up- 
stream node Outji^ and the output sequence Outi for 
the node i is the same as the input sequence of a down- 
stream node Irik. When node i has multiple output 
connections, it has the same binary sequence because 
state variables in networks are subject to Eq. ([T]). 



larger mutual information. These results suggest that 
the collective (global) coherence in the state variables 
of the networks may be due to the style of upstream 
(local) conditions, including connections among the 
upstream nodes and assignment of the Boolean func- 
tions. 

4.2 Transmission characteristic function 

To elucidate dependence of rank on randomness and 
coherence, we first focus on the local structure around 
the hubs as shown in Fig. [H Because each node has 
two inputs by definition, outputs from the hubs are 
subjected to 4 inputs and 3 Boolean functions. From 
numerical results, we obtain statistical properties to 
determine the relationships between the 4 inputs. Fig- 
ure [5] shows two statistical properties: (1) Range of 
input probability is almost limited from 0.0 to 0.5. (2) 
Degree of correlations between inputs is very low in 
the range of input probability. 

The two statistical properties allow us to take the 
following analytical approach. We define the out- 
put property as a function of the input probability, 
called transmission characteristic function [see Fig. [6]. 
For simplicity, we assume that the 4 inputs {pi — 
in Fig. [4]) receive binary sequence with the same 
probability [6jJ. The transmission characteristic func- 
tions can be described as at the most of 4th order 
polynomial and obtained by combining Boolean func- 
tions [Table [3] on the local structure [Fig. [4]. 
When we ignore the specificity of the Boolean func- 
tions in upstream nodes in a local structure, we can ob- 
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Figure 3: Dependence of proportion of positive en- 
tropy (a) and (c) and mutual information (b) and (d) 
on type I and II distribution in Fig. [H Three different 
symbols denote different types of Boolean function on 
hubs; square: type 8, triangle: type 2 or 4, and cir- 
cle: type 1 [see Table [l]. The vertical bar "|" in the 
legend denotes either of the Boolean function on each 
side of the bar. H denotes the hub's Boolean function. 
Dashed horizontal lines indicate the proportions from 
all realizations [see Table [2] . 



tain the average transmission characteristic function- 
considering only the hub's Boolean function, weighted 
average of the individual transmission characteristic 
functions can be obtained. The average transmission 
characteristic function can be written as 

< [p^:r\p) = \)< {p!>:r\p) = ^) , (2) 

where an asterisk "*" denotes any one of the 
Boolean functions in Table [TJ The triple asterisks in 
the braces represent the average transmission charac- 
teristic function from the over all 18 [see Tableland 
Fig. [6] Boolean function combinations. The order of 
their entropies is described as 

<ff(pi:r^(p))<if(pi^r^(p)). (3) 

The same order of entropy size is already shown in 
Fig. [3] (a) and (c). In particular, the tendency can 
be seen in higher ranked hubs in both styles I and 
II, demonstrating that the transmission characteristic 
functions are useful tools to infer network dynamics. 

5 Summary and Discussion 

On comparing the average transmission characteris- 
tic functions and numerical results, we obtained good 
relationships between them, suggesting that the local 
structure at the hubs affects global dynamical prop- 
erties in the networks. These results also provide a 
blueprint of design principle for an artificial gene reg- 
ulatory network, and help to elucidate the role of hubs 
in dynamical system. 

In recent years, many large-scale complex networks 
such as social, metabolic, and neural networks have 
been paid great attention from many fields. It has 
been revealed that the biological networks contain 
prominent local structures, called motif, subgraph or 
clique that consist of a small number of nodes and 
edges [71 IB]- In this paper, we demonstrate just one of 
the local structures in simplified dynamical model for 
the transcriptional regulatory networks. In fact, size 
of the biological complex adaptive systems varies over 
a very long time because of many various events. Since 
clique models^ seem to be a promising approach 



for explaining growing complex networks, an exchange 
of information among local structures may contribute 
to the mechanisim for maintenance and growth of com- 
plex networks. 
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6 Appendix 



Table 2: Numbers of realizations out of IQ^ networks 
are indicated. Four different Boolean functions [see 
Table [1] at the hubs are used with equal probability. 
"H" in the table denotes the hubs Boolean function 
[see FigH]. 
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Figure 4: Typical local structure around a hub. 
Squares and directed edges (arrows) correspond to the 
nodes and connections of binary sequence pathways, 
respectively. Dashed arrows indicate inputs from up- 
streams. H and U in the squares correspond to the 
Boolean function on hub and its upstream nodes. Each 
node has one of the Boolean functions, 1, 2, 4, and 8 
as shown in Table [TJ A set of three characters in a 
brace at the bottom of each figure denotes a combi- 
natorial set of the Boolean function on nodes in the 



local structure. P, 



iH,U,U) 



{p) represents transmission 



characteristic function of input probability p [see Fig. 
[6] and the combination of the Boolean functions [see 
Table [3]. 
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Figure 5: Statistical properties of inputs to the local 
structure in Fig. [H (a) Cumulative distribution of in- 
put probability (pi —^4). (b) Cumulative mutual infor- 
mation between 4 inputs, (c) Correlation between in- 
put probability (a) and mutual information (b). These 
distributions are obtained from Ist-ranked hubs on the 
basis of 7Q622 attractors from IQ^ networks with style 
I distribution and 2xlQ'' initial states. 
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Table 3: The combination number of the Boolean 
functions on the local structure shown in Fig. [H 64 
(= 4^) combinations can be reduced to 18 because of 
the symmetry in the local structure [see Fig. [4] and 
in-out relations in the Boolean functions [see Table [T] . 
There are two major columns, and each major col- 
umn consists two subcolumns. The left subcolumns 
contain all possible combinations of the Boolean func- 
tions in the case that hub has one of the Boolean fun- 
tions. The right subcolumns indicate integrated com- 
binations. The combinations with dagger can be con- 
solidated with the combinations with prime. A set of 
numbers at both ends of the arrow at the bottom line 
in each major column denotes the original and reduced 
number of combinations. When Boolean function of 8 
is located in the hub, the same procedure as shown in 
left major column can be taken. 
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Figure 6: Example of transmission characteristic func- 
tions (a)-(d) and their output entropy (e)-(h). Each 
set of 3 characters in a brace shows a Boolean func- 
tion combination [see Table [T] and Fig. [4]. A ver- 
tical bar "I" denotes either of the Boolean functions 
on each side of the bar. An asterisk "*" denotes 
any of the Boolean functions in Table [H The triple 
asterisks, (*,*,*) indicates all the 18 possible combi- 
nations, (a) Transmission characteristic function for 
(1,1,1), P^ut'^^ ^V) — P^' Other transmission charac- 
teristic functions are also described as at the most of 
4th order polynomial, (c) Entropy of the transmis- 
sion characteristic function in (a), (d) Average trans- 
mission characteristic functions as indicated in braces, 
(h) Entropy of the transimission characteristic func- 
tion in (d). As a guide for (a)-(d), thick region of 
these curves correspond to p G [0,0.5]. Dashed lines 
show Pout{p) = p OT H{Pout{p)) = P relationship for 
(e)-(h). 



